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Method and device for controlling a reproduction 



unit using a multi-channel signal 

The present invention relates to a method and a device for controlling 
a sound field reproduction unit comprising a plurality of reproduction elements, 
using a plurality of sound or audiophonic signals each associated with a 
predetermined general reproduction direction defined relative to a given point in 
5 space. 

Such a set of signals is commonly referred to by the expression "multi- 
channel signal" and corresponds to a plurality of signals, called channels, which 
are transmitted in parallel or multiplexed with each other and each of which is 
intended for a reproduction element or a group of reproduction elements, 
10 arranged in a general direction predefined relative to a given point. 

For example, a conventional multi-channel system is known under the 
name "5.1 ITU-R BF 775-1" and comprises five channels intended for 
reproduction elements placed in five predetermined general directions relative to 
a listening centre, which directions are defined by the angles 0°, + 30°, -30°, 
15 +110° and-110°. 

t Such an arrangement therefore corresponds to the arrangement of a 
loudspeaker or a group of loudspeakers at the front in the centre, one on each 
side at the front on the right and the left and one on each side at the rear on the 
right and the left. 

20 Since the control signals are each associated with a specific direction, 

the application of these signals to a reproduction unit whose elements do not 
correspond to the predetermined spatial configuration brings about substantial 
deformation of the sound field reproduced. 

There are systems which incorporate delay means on the channels in 

25 order to compensate at least partially for the distance between the reproduction 
elements and the listening centre. However, these systems do not enable the 
arrangement of the reproduction unit in space to be taken into account. 

It therefore appears that no existing method or system permits high- 
quality reproduction using a signal of the multi-channel type with a reproduction 

30 unit having any spatial configuration. 
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An object of the present invention is to overcome this problem by 
defining a method and a system for controlling the reproduction unit whose 
spatial configuration may be of any type. 

The invention relates to a method for controlling a sound field 
5 reproduction unit comprising a- plurality of reproduction elements each associated 
with a predetermined general reproduction direction defined relative to a given 
point, in order to obtain a reproduced sound field of specific characteristics that 
are substantially independent of the intrinsic reproduction characteristics of the 
unit, characterized in that the method comprises: 
10 - a step for determining at least spatial characteristics of the 

reproduction unit, permitting the determination of parameters that are 
representative, in the case of at least one element of the reproduction unit, of its 
position in the three spatial dimensions relative to the given point; 

- a step for determining adaptation filters using the at least spatial 
15 characteristics of the reproduction unit and the predetermined general 

reproduction directions associated with the plurality of sound data input signals; 

- a step for determining at least one signal for controlling the elements 
of the Reproduction unit by applying the adaptation filters to the plurality of sound 
data input signals; and 

20 - a step for providing the at least one control signal with a view to 

application to the reproduction elements. 
According to other features: 

- the step for determining at least spatial characteristics of the 
reproduction unit comprises an acquisition sub-step enabling all or some of the 

25 characteristics of the reproduction unit to be determined; 

- the step for determining at least spatial characteristics of the 
reproduction unit comprises a calibration step enabling all or some of the 
characteristics of the reproduction unit to be provided; 

- the calibration sub-step comprises, in the case of at least one of the 
30 reproduction elements: 

- a sub-step for transmitting a specific signal to the at least one 
element of the reproduction unit; 

- a sub-step for acquiring the sound wave emitted in response by 
the at least one element; 
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- a sub-step for converting the acquired signals into a finite 
number of coefficients representative of the emitted sound wave; and 

- a sub-step for determining spatial and/or sound parameters of 
the element on the basis of the coefficients representative of the emitted sound 

5 wave; 

- the calibration sub-step also comprises a sub-step for determining 
the position in at least one of the three spatial dimensions of the at least one 
element of the reproduction unit; 

- the calibration step comprises a sub-step for determining the 
10 frequency response of the at least one element of the reproduction unit; 

- the step for determining adaptation filters comprises: 

- a sub-step for determining a decoding matrix representative of 
filters permitting compensation for the changes in reproduction caused by the 
spatial characteristics of the reproduction unit; 

15 -a sub-step for determining an ideal multi-channel radiation 

matrix representative of the predetermined general directions associated with 
each data signal of the plurality of input signals; and 

' - a sub-step for determining a matrix representative of the 
adaptation filters using the decoding matrix and the multi-channel radiation 

20 matrix; 

- the step for determining adaptation filters comprises a plurality of 
calculation sub-steps providing a limit order of spatial precision of the adaptation 
filters, a matrix corresponding to a spatial window representative of the 
distribution in space of the desired precision during the reconstruction of the 

25 sound field and a matrix representative of the radiation of the reproduction unit, 
the sub-step for calculating the decoding matrix being carried out using the 
results of these calculation sub-steps; 

- the matrices for decoding, ideal multi-channel radiation and 
adaptation are independent of the frequency, the step for determining at least one 

30 signal for controlling the elements of the reproduction unit by applying the 
adaptation filters corresponding to simple linear combinations followed by a 
delay; 

- the step for determining characteristics of the reproduction unit 
permits the determination of sound characteristics of the reproduction unit and 
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the method comprises a step for determining compensation filters for these sound 
characteristics, the step for determining at least one control signal then 
comprising a sub-step for applying the sound compensation filters; 

- the step for determining sound characteristics is suitable for providing 
5 parameters that are representative, in the case of at least one element, of its 

frequency response; 

- the step for determining at least one control signal comprises a sub- 
step for adjusting the gain and applying delays in order to align temporally the 
wavefront of the reproduction elements as a function of their distance from the 

10 given point. 

The invention relates also to a computer program comprising program 
code instructions for performing the steps of the method when the program is 
performed by a computer. 

The invention relates also to a removable medium of the type 
15 comprising at least one processor and a non-volatile memory element, 
characterized in that the memory comprises a program comprising code 
instructions for performing the steps of the method, when the processor performs 
the program. 

The invention relates also to a device for controlling a sound field 
20 reproduction unit comprising a plurality of reproduction elements, comprising 
input means for a plurality of sound data input signals each associated with a 
predetermined general reproduction direction defined relative to a given point, 
characterized in that it also comprises: 

- means for determining at least spatial characteristics of the 
25 reproduction unit, permitting the determination of parameters that are 

representative, in the case of at least one element of the reproduction unit, of its 
position in the three spatial dimensions relative to the given point; 

- means for determining adaption filters using the at least spatial 
characteristics of the reproduction unit and the predetermined general 

30 reproduction directions associated with the plurality of sound data input signals; 
and 

- means for determining at least one signal for controlling the elements 
of the reproduction unit by applying the adaptation filters to the plurality of sound 
data input signals. 
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According to other features of this device: 

- the means for determining the at least spatial characteristics of the 
reproduction unit comprise means for the direct acquisition of the characteristics; 

- it is suitable for being associated with calibration means permitting 
5 the determination of the at least spatial characteristics of the reproduction unit; 

- the calibration means comprise means for acquiring a sound wave 
which comprise four pressure sensors arranged in accordance with a general 
tetrahedral shape; 

- the means for determining characteristics are suitable for determining 
10 sound characteristics of at least one of the reproduction elements of the 

reproduction unit, the device comprising means for determining sound 
compensation filters using the sound characteristics, and the means for 
determining at least one control signal being suitable for applying the sound 
compensation filters; 

15 - the means for determining the sound characteristics are suitable for 

determining the frequency response of the elements of the reproduction unit. 

The invention relates also to an apparatus for processing audio and 
video data, comprising means for determining a plurality of sound data input 
signals each associated with a predetermined general reproduction direction 

20 defined by a given point, characterized in that it also comprises a device for 
controlling a reproduction unit; 

- the means for determining a plurality of input signals are formed by a 
unit for reading and decoding digital audio and/or video discs. 

The invention will be better understood on reading the following 
25 description which is given purely by way of example and with reference to the 
appended drawings in which : 

- Figure 1 is a representation of a spherical coordinate system; 

- Figure 2 is a diagram of a reproduction system according to the 

invention; 

30 - Figure 3 is a flow chart of the method of the invention; 

- Figure 4 is a diagram of calibration means used in the method of the 

invention; 

- Figure 5 is a detailed flow chart of the calibration step; 
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- Figure 6 is a simplified representation of a sensor used for the 
implementation of the calibration step; 

- Figure 7 is a detailed flow chart of the step for determining adaptation 

filters; and 

5 - Figures 8 and 9 are diagrams of means for determining control 

signals; and 

- Figure 10 is a diagram of an embodiment of a device using the 
method of the invention. 

Figure 1 shows a conventional spherical coordinate system in order 
10 to indicate the coordinate system to which reference is made in the text. 

This coordinate system is an orthonormal coordinate system having 
an origin O and comprising three axes (OX), (OY) and (OZ). 

In this coordinate system, a position indicated x is described by 
means of its spherical coordinates (r,6>$ 5 where r denotes the distance relative to 
15 the origin 0, 0 the orientation in the vertical plane and <f> the orientation in the 
horizontal plane. 

In such a coordinate system, a sound field is known if the sound 
pressure indicated p(r,0,<f>,t), whose temporal Fourier transform is indicated 
P(r,0 } 0,f) where/denotes the frequency, is defined at all points at each instant t 
20 The invention is based on the use of a family of spatio-temporal 

functions enabling the characteristics of any sound field to be described. 

In the embodiment described, these functions are what are known as 
spherical Fourier-Bessel functions of the first kind which will be referred to 
hereinafter as Fourier-Bessel functions. 
25 In a region empty of sound sources and empty of obstacles, the 

Fourier-Bessel functions are solutions of the wave equation and constitute a 
basis which generates all the sound fields produced by sound sources located 
outside this region. 

Any three-dimensional sound field is therefore expressed by a linear 
30 combination of the Fourier-Bessel functions in accordance with the expression of 
the inverse Fourier-Bessel transform which is expressed: 

P (r 04 , f)= 4 n £ X Pi, m (f)j l ji{kr ) yr ( 0 \<j>) 
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In this equation, the terms P,, m (J) are, by definition, the Fourier-Bessel 

coefficients of the field p(r,0,fat), k=^f, c is the speed of sound in air (340 ms' 1 ), 

Jt(kr) is the spherical Bessel function of the first kind and of order / defined by 

Jt ( x y= J M i 2 (x) where J v (x) is the_Bessel function_of. the first kind and of order 

v, and yi m (8,0) is the real spherical harmonic of order / and of term m, with m 
ranging from -/ to /, defined by: 



)= ^(cos 0) cos( m <j>) pour m>0 



J — P,°(cos0) pour m=0 



J— P, H (cos 0) sin( m </>) pour m<0 



In this equation, the P, m (x) are the associated Legendre functions 
defined by: 

10 «*>=/FaIs| & p ' w 

with Pi(x) denoting the Legendre polynomials, defined by: 

The Fourier-Bessel coefficients are also expressed in the temporal 
domain by the coefficients p hm {t) corresponding to the inverse temporal Fourier 
1 5 transform of the coefficients Pijj). 

In a variant, the method of the invention operates on the basis of 
functions which are expressed as optionally infinite linear combinations of 
Fourier-Bessel functions. 

Figure 2 shows diagrammatically a reproduction system in which the 
20 method of the invention is used. 

This system comprises a decoder or adaptor 1 controlling a 
reproduction unit 2 which comprises a plurality of elements 3i to 3 N} such as 
loudspeakers, baffles or any other sound source or group of sound sources, 
which are arranged in any manner at a listening site 4. The origin O of the 
25 coordinate system, which is called the centre 5 of the reproduction unit, is placed 
arbitrarily in the listening site 4. 
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The set of spatial, sound and electrodynamic characteristics are 
regarded as being the intrinsic characteristics of the reproduction unit 2. 

The adaptor 1 receives as an input a signal SI of the multi-channel 
type comprising sound data to be reproduced and a definition signal SL 
5 comprising data representative of at least spatial characteristics of the 
reproduction unit 2 and permitting, in particular, the determination of parameters 
that are representative, in the case of at least one element 3 n of the reproduction 
unit 2, of its position in the three spatial dimensions relative to the given point 5. 

At the end of the processing operation corresponding to the method of 
10 the invention, the adaptor 1 transmits for the attention of each of the elements or 
groups of elements 3i to 3 N of the reproduction unit 2, a specific control signal sci 

to SCa/. 

Figure 3 shows diagrammatically the main steps of the method 
according to the invention used with a reproduction system such as that 
1 5 described with reference to Figure 2. 

This method comprises a step 10 for determining operating 
parameters which is suitable for permitting at least the determination of the 
spatial characteristics of the reproduction unit 2. 

Step 10 comprises a parameter acquisition step 20 and/or a calibration 
20 step 30 enabling characteristics of the reproduction unit 2 to be determined 
and/or measured. 

In the embodiment described, step 10 also comprises a step 40 for 
determining parameters for describing the predetermined general directions 
associated with the various channels of the multi-channel input signal SI. 
25 At the end of step 10, data relating at least to the various 

predetermined general directions associated with each of the input channels as 
well as the position in the three spatial dimensions of each of the elements or 
groups of elements 3 n of the reproduction unit 2 are determined. 

These data are used in a step 50 for determining the adaptation filters 
30 enabling the spatial characteristics of the reproduction unit 2 to be taken into 
account in order to define filters for adapting the multi-channel input signal to the 
specific spatial configuration of the reproduction unit 2. 

Advantageously, step 10 also enables sound characteristics for all or 
some of the elements 3i to 3 N of the reproduction unit 2 to be determined. 
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In that case, the method comprises a step 60 for determining sound 
compensation filters enabling the influence of the specific sound characteristics of 
the elements 3i to 3 N to be compensated for. 

The filters defined in step 50, and advantageously in step 60, can thus 

5 be stored , in a .memory , so that steps 10, 50 and. 60 have to . be repeated only if 

the spatial configuration of the reproduction unit 2 and/or the nature of the multi- 
channel input signal is modified. 

The method then comprises a step 70 for determining the control 
signals sci to sca/ intended for the elements of the reproduction unit 2, comprising 
10 a sub-step 80 for applying the adaptation filters determined in step 50 to the 
various channels c\(f) to c Q (t) forming the multi-channel input signal SI and 
advantageously a sub-step 90 for applying the sound compensation filters 
determined in step 60. 

The signals sc^ to sc N thus provided are applied to the elements 3^ to 
15 3 N of the reproduction unit 2 in order to reproduce the sound field represented by 
the multi-channel input signal SI with optimum adaptation to the spatial, and 
advantageously sound, characteristics of the reproduction unit 2. 

It therefore appears that, owing to the use of the method of the 
invention, the characteristics of the reproduced sound field are substantially 
20 independent of the intrinsic reproduction characteristics of the reproduction unit 2 
and, in particular, of its spatial configuration. 

The main steps of the method of the invention will now be described in 
more detail. 

In the parameter acquisition step 20, an operator or a suitable memory 
25 system can specify all or some of the calculation parameters and especially: 

- parameters x„ expressed in the spherical coordinate system by 
means of the coordinates r m 0 W and <f> n and representative of the position of the 
elements 3„ relative to the listening centre 5; and/or 

- parameters H n {f) representative of the frequency response of the 
30 elements 3 n . 

This step 20 is implemented by means of an interface of a 
conventional type, such as a microcomputer or any other appropriate means. 

Calibration step 30 as well as means for implementing this step will 
now be described in more detail. 
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Figure 4 shows calibration means in detail. They comprise a 
decomposition module 91, an impulse response determination module 92 and a 
calibration parameter determination module 93. 

The calibration means are suitable for being connected to a sound 
5 acquisition device 100, such as a microphone or any other suitable device, and 
for being connected in turn to each element 3 n of the reproduction unit 2 in order 
to sample data on this element. 

Figure 5 shows in detail an embodiment of calibration step 30 which is 
used by the calibration means described above and which enables characteristics 
1 0 of the reproduction unit 2 to be measured. 

In a sub-step 32, the calibration means transmit a specific signal u n (t) 
such as an MLS (Maximum Length Sequence) pseudo-random sequence for the 
attention of an element 3 n . The acquisition device 100 receives, in a sub-step 34, 
the sound wave emitted by the element 3 n in response to receiving the signal u n (t) 
15 and transmits / signals cp\(t) to cptf) representative of the wave received to the 
decomposition module 91. 

In a sub-step 36, the decomposition module 91 decomposes the 
signals sensed by the acquisition device 100 into a finite number of Fourier- 
Bessel coefficients qi, m {f). 
20 For example, the acquisition device 100 is constituted by 4 pressure 

sensors located at the 4 apices of a tetrahedron of radius R as shown with 
reference to Figure 6. The signals of the 4 pressure sensors are therefore 
indicated cp x (t) to cp 4 <7). The coefficients g 0y0 (J) to # u (r) representative of the 
sound field sensed are deduced from the signals cp\(t) to cp 4 (0 in accordance 
25 with the following relationships: 

^ i CPxj f) + CP 2 [f) + CP z (f) + CPJJ) 

QoAf} = 7^ 3 

«!._!(/) = -3^= (Cft (/) - CP 2 (f) + Cft(/) - CP,(f)) 

QiMf) = ^ ^7 + CP ^(/) - cp 3 (/) - cp,(f)) 
o« W - 5^ ^7 (CFl{/) - CP2(/) - CP3(/) + CP4(/)) 

In these relationships CP\(j) to CP 4 (/) are the Fourier transforms of 
cpxif) to cp 4 (t) and g 0 ,o(/) to Q lA (f) are the Fourier transforms of q 0 ,o(0 to gi f ,(/). 
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When these coefficients are defined by the module 91, they are 
addressed to the response determination module 92. 

In a sub-step 38, the response determination module 92 determines 
the impulse responses hpi tm (f) which link the Fourier-Bessel coefficients qi, m (f) and 
5 the transmitted signal u n (t). The method of determination depends on the specific 
signal transmitted. The embodiment described uses a method suitable for signals 
of the MLS type, such as, for example, the correlation method. 

The impulse response provided by the response determination module 
92 is addressed to the parameter determination module 93. 
10 In a sub-step 39, the module 93 deduces data on elements of the 

reproduction unit. 

In the embodiment described, the parameter determination module 93 
determines the distance r n between the element 3 n and the centre 5 on the basis 
of its response /ipo,o(0 and the measurement of the time taken by the sound to 
15 propagate from the element 3„ to the acquisition device 100, by means of 
methods for estimating the delay in the response hp 0t0 (t). 

The direction (0 n ,&d of the element 3 n is deduced by calculating the 
maximum of the inverse spherical Fourier transform applied to the responses 
fcpo,o(0 to /zp u (0 taken at the instant t where hp 0 ,o(i) is at a maximum. 
20 Advantageously, the coordinates 6 n and <z>„ are estimated at several instants, 
preferably chosen around the instant where hp 0 ,o(0 is at a maximum. The final 
determination of the coordinates 9 n and fa is obtained by means of techniques of 
averaging between the various estimates. 

Thus, in the embodiment described, the acquisition device 100 is 
25 capable of unambiguously encoding the orientation of a source in space. 

By way of variation, the coordinates 6 n and fa are estimated on the 
basis of other responses among the hpi, m (f) available or they are estimated in the 
frequency domain on the basis of the responses HP^Jf), corresponding to the 
Fourier transforms of the responses hpi >m (t). 
30 Thus step 30 enables the parameters r m 6 n and fa\o be determined. 

In the embodiment described, the module 93 also provides the transfer 
function H n (f) of each element 3 n , on the basis of the responses hpi t Jj) coming 
from the response determination module 92. 
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A first solution consists in constructing the response hp' 0t o(f) 
corresponding to the selection of the portion of the response hp 0 ,o(0 which 
includes a non-zero signal free from reflections introduced by the listening site 4. 
The frequency response H n (f) is deduced by Fourier transform of the response 
5 hp q,o(0 previously windowed. The window may be selected from among .the 
conventional smoothing windows, such as, for example, the rectangular, 
Hamming, Hanning, and Blackman windows. 

A second, more complex, solution consists in applying smoothing to 
the module and advantageously to the phase of the frequency response HP 0t0 {f) 
10 obtained by Fourier transform of the response hp 0 ,o(t). For each frequency/ 
smoothing is obtained by convolution of the response HP 0 ,o(f) by a window 
centered on / This convolution corresponds to an averaging of the response 
HP 0 ,o(j) around the frequency / The window may be selected from among the 
conventional windows, such as, for example, rectangular, triangular and 
15 Hamming windows. Advantageously, the width of the window varies with the 
frequency. For example, the width of the window may be proportional to the 
frequency / at which smoothing is applied. Compared with a fixed window, a 
window which is variable with the frequency permits the at least partial elimination 
of the room effect in the high frequencies while at the same time avoiding an 
20 effect of truncating the response HP 0 ,o(f) in the low frequencies. 

The sub-steps 32 to 39 are repeated for all of the elements 3i to 3 N of 
the reproduction unit 2. 

By way of variation, the calibration means comprise other means of 
acquiring data relating to the elements 3i to 3 Nt such as laser position-measuring 
25 means, means for processing the signal which use techniques of path formation 
or any other appropriate means. 

The means implementing calibration step 30 are constituted, for 
example, by an electronic card or a computer program or any other appropriate 
means. 

30 As stated above, step 40 permits the determination of the parameters 

describing the format of the multi-channel input signal and especially the general 
predetermined directions associated with each channel. 

This step 40 may correspond to a selection, by an operator, of a format 
from a list of formats which are each associated with parameters stored in the 
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memory, and may also correspond to automatic format detection carried out on 
the multi-channel input signal. Alternatively, the method is adapted to a single 
given multi-channel signal format. In yet another embodiment, step 40 enables a 
user to specify his own format by manually acquiring the parameters describing 
5 the directions associated with each channel. 

It appears that steps 20, 30 and 40 forming the parameter 
determination step 10 permit at least the determination of parameters for the 
positioning in space of the elements 3„ of the reproduction unit 2 and of the 
format of the multi-channel signal SL 
10 Figure 7 shows a detailed flow chart of step 50 for determining the 

adaptation filters. 

This step comprises a plurality of sub-steps for calculating and 
determining matrices representative of the parameters determined previously. 

Thus, in a sub-step 51, a parameter Z, called the limit order 
15 representative of the spatial precision desired in step 50 for determining the 
adaptation filters, is determined, for example, in the following manner: 

- the smallest angle a min formed by a pair of elements of the 
reproduction unit 2 is calculated automatically by means of a trigonometric 
relationship, such as, for example: 

20 a„i*,„ 2 * = acos(sin(9 nl sin^ 2 cos(^ t -^ 2 ) + cos^cos^) 

a min = rnin(<2„7 ( „2) 

among the set of pairs {nl, n2) , such as nl* n2; and 

- then, the maximum order L is determined automatically as being the 
largest integer complying with the following relationship: 

25 L<nl a min . 

Step 50 for determining adaptation filters then comprises a sub-step 52 
for determining a matrix W for weighting the sound field. This matrix W 
corresponds to a spatial window W(rJ) representative of the distribution in space 
of the precision desired during the reconstruction of the field. Such a window 

30 enables the size and shape of the region where the field is to be correctly 
reconstructed to be specified. For example, it may be a ball centred on the centre 
5 of the reproduction unit. In the embodiment described, the spatial window and 
the matrix Ware independent of the frequency. 
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W is a diagonal matrix of size (X+l) 2 which contains weighting 
coefficients W\ and in which each coefficient W\ is found 2/+1 times in succession 
on the diagonal. The matrix W therefore has following form: 



W 0 0 
0 W x 



0 



0 



0 
0W L 



5 In the emdodiment described, the values assumed by the coefficients 

W\ are the values of a function such as a Hamming window of size 2Z+1 
evaluated in /, so that the parameter W t is determined for / ranging from 0 to L. 

Step 50 then comprises a sub-step 53 for determining a matrix M 
representative of the radiation of the reproduction unit, especially on the basis of 
10 the position parameters x n . The radiation matrix M makes it possible to deduce 
Fourier-Bessel coefficients representing the sound field emitted by each element 
3„ of the reproduction unit as a function of the signal which it receives. 

M is a matrix of size (L+l) 2 by N, constituted by elements M^*, the 
indices l,m denoting the row / 2 +/+/w and n denoting the column n. The matrix M 
1 5 therefore has the following form: 



20 



6,0.1 ^ 0,0,2 • 
Mi rU M \ - i 2 ' 

M lf0 ,l Af^o.2 • 

Af t, 0 j M^ j0> 2 Af t0i N 

M LfLt] M ltLa M L)LiA r 

In the embodiment described, the elements Mi >m ,n are obtained on the 
basis of a plane wave radiation model, with the result that: 

The matrix M thus defined is representative of the radiation of the 
reproduction unit. In particular, M is representative of the spatial configuration of 
the reproduction unit. 
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The sub-steps 51 to 53 may be performed sequentially or 
simultaneously. 

Step 50 for determining adaptation filters then comprises a sub-step 54 
for taking into account the set of parameters of the reproduction system 2 which 
5 were determined previously, in order to provide a decoding matrix D 
representative of so-called reconstruction filters. 

The elements D nXm if) of the matrix D correspond to reconstruction 
filters which, when applied to the Fourier-Bessel coefficients of a known 

sound field, permit the determination of the signals for controlling a reproduction 
10 unit in order to reproduce this sound field. 

The decoding matrix D is therefore the inverse of the radiation matrix 

M. 

Matrix D is obtained from matrix M by means of inversion methods 
under constraints which involve supplementary optimization parameters. 
15 In the embodiment described, step 50 is suitable for carrying out an 

optimization operation thanks to the matrix for weighting the sound field W which, 
in particular, enables the spatial distortion in the reproduced sound field to be 
reduced. 

This matrix D is provided especially from matrix Af, in accordance with 
20 the following expression: 

D = (M T WMJ l M r W 
in which M T is the conjugated transposed matrix of M. 

In the embodiment described, the matrices M and W are independent 
of the frequency, so that the matrix D is likewise independent of the frequency. 
25 The matrix D is constituted by elements indicated D nXm organized in the following 
manner: 

A ,o,o A, i,~i A, uo A.i.r - - A.L.-L--- A.z.0--- A.L./. 
A,o,o A t i -i A, i,o Au,r • • A,i,-r • " A,l,o* • • A>,l,l 

jA^,oAv,i -iAsu,oAv,u" * ' Av,i -V * " Av,i,o' * " Av,z,,l_ 
Step 54 thus enables the matrix D representative of so-called 
reconstruction filters and permitting the reconstruction of a sound field on the 
30 basis of any configuration of the reproduction unit to be provided. Owing to this 
matrix, the method of the invention makes it possible to take into account the 
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configuration of the reproduction unit 2 and, in particular, to compensate for the 
alterations in the sound field caused by its specific spatial configuration. 

By way of variation, the parameters relating to the reproduction unit 2 
may be variable as a function of the frequency. 
5 For example, in such an embodiment, each element D n ^JJ) of the 

matrix D can be determined by associating with each of the N control signals a 
directivity function D n (0Jj) specifying at each frequency / the amplitude and, 
advantageously, the phase desired on the control signal sc n in the case of a 
plane wave in the direction 

10 A directivity function D n (0><f>j) means a function which associates a real 

or complex value, which is optionally a function of the frequency or a range of 
frequencies, with each spatial direction. 

In the embodiment described, the directivity functions are independent 
of the frequency and are indicated D n (0,0). 

15 These directivity functions D n (0,<fi) can be determined by specifying that 

specific physical quantities between an ideal field and the same field reproduced 
by the reproduction unit comply with predetermined laws. For example, these 
quantities may be the pressure at the centre and the orientation of the velocity 
vector. In some cases, it is desired that only 3 control signals should be active in 

20 reproducing a plane wave. The active control signals, indicated sc n i to sc n z, are 
those which supply the reproduction elements whose directions are closest to the 
direction (<9,$ of the plane wave. The active reproduction elements, indicated 3„i 
to 3^3, form a triangle containing the direction (0,0) of the plane wave. In that 
case, the values of the directivities D n} (0,<p) to D n3 (0,<p) associated with the 3 active 

25 elements 3m to 3„ 3 are given by: 

r-V 

Q = — rr— 

i T r _1 r 

with 

(sin 0 ni cos 0 Tll sin 0 n2 cos 4> 7l2 sin 0 na cos 4> ns \ /sin 0 cos <f> l 

sin0 m sin<£ ni sin 0 n2 sin <p n a sin $ nz sin <f> n3 J r = sin 0 sin 0 H = 
cos0 ni cos0 n2 cos 0 ni J \ COS0 / 

In this relationship, a corresponds to the vector containing 
30 [D nl (0 9 <p)...D n3 (0,0)] and the directions (e nh <f> n i\ (0 n 2M and (0 n s^s) correspond to 
the directions of the elements 3„i, 3 n2 and 3 n3 , respectively. 

The values of the directivities D n (6,<p) corresponding to the non-active 
reproduction elements are considered to be zero. 
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The previous relationship is repeated for K directions of different 
plane waves. Thus, each of the directivity functions D n {0,<j>) is supplied in the form 
of a list of K samples. Each sample is supplied in the form of a pair 
{((0k,0k), D n (O k ,<f>k))} where (&k,A) is the direction of the sample k and where 
5 D n (0 k ,0 k ) is the value of the directivity function associated with the control signal 
sc n for the direction (ft,$t). 

For each frequency / the coefficients £>„,/,»,(/) of each directivity 
function are deduced from the samples {{(0 k ,<f> k \ D n (0 k ,0 k ))}. These coefficients 
are obtained by inverting the angular sampling process which permits deduction 
10 of the samples from the list D n (0 k ,</> k ))} on the basis of a directivity 

function supplied in the form of spherical harmonic coefficients. This inversion 
may assume different forms in order to control the interpolation between the 
samples. 

In other embodiments, the directivity functions are supplied directly in 
1 5 the form of coefficients D n ^Jf) of the Fourier- Bessel type. 

The coefficients D nJ>m (f) thus determined are used to form the matrix D. 
Step 50 then comprises a step 55 for determining an ideal multi- 
channel radiation matrix S representative of the predetermined general directions 
associated with each channel of the multi-channel input signal SI. 
20 The matrix S is representative of the radiation of an ideal reproduction 

unit, that is to say, complying exactly with the predetermined general directions of 
the multi-channel format. Each element Si >m>g (f) of the matrix S enables the 
Fourier-Bessel coefficients Pi, m (f) of the sound field ideally reproduced by each 
channel c q (i). to be deduced. 
25 The matrix S is determined by associating with each input channel c q (t) 

and advantageously for each frequency / a directivity pattern representative of a 
distribution of sources assumed to emit the signal of the channel c q (f). 

The distribution of sources is given in the form of spherical harmonic 
coefficients 5/, m><7 (/). The coefficients S^ m>q (f) are arranged in the matrix S of size 
30 (L+\) 2 over Q, where Q is the number of channels. 

In the embodiment described, the formatting step associates with each 
channel c q (t) a plane wave source oriented in the direction (0 q ^ q ) corresponding 
to the direction (0$ , $ ) associated with the channel c q (i) in the multi-channel input 
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format. The coefficients S hmjq (j) are therefore independent of the frequency. They 
are indicated 5/, m>9 and are obtained by the relationship: 

In other embodiments, the ideal radiation matrix S associates a 
discrete distribution of plane wave sources with specific channels in order to 
simulate the effect of a ring of loudspeakers. In that case, the coefficients S/, m ,<, are 
obtained by adding up the contributions of each of the elemental sources. 

In yet other embodiments, the ideal radiation matrix 5" associates 
specific channels c q {i) with a continuous distribution of plane wave sources which 
is described by a directivity function S q (0,<p). In that case, the coefficients 5/ >m>9 of 
the matrix S are obtained directly by spherical Fourier transform of the directivity 
function S q {0,$). In these embodiments, the matrix S is independent of the 
frequency. 

In other, more complex, embodiments, the matrix S associates with 
specific channels a distribution of sources producing a diffuse field. In that case, 
the matrix S varies with the frequency. These embodiments are suitable for multi- 
channel formats that consider the front and rear channels differently. For 
example, in applications intended for reproduction in cinema rooms, the rear 
channels are often intended to recreate a diffuse ambience. 

In other embodiments, the matrix S associates with specific channels 
sound sources whose response is not flat. For example, if the multi-channel 
format associates with the channel c q (t) a plane wave source having the 
frequency response rf q) {f), the S,, m , q (J) vary with the frequency and are obtained 
by the relationship: 

If the multi-channel format associates with specific channels a 
superposition of the above-mentioned types of source distribution, the 
coefficients S,, m , q (f) of the radiation matrix are obtained by adding up the 
coefficients associated with each type of source distribution. 

Finally, step 50 includes a sub-step 56 for determining a spatial 
adaptation matrix A corresponding to the adaptation filters to be applied to the 
multi-channel input signal in order to obtain optimum reproduction taking into 
account the spatial configuration of the reproduction unit 2. 
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The spatial adaptation matrix A is obtained from the matrices for 
shaping S and decoding D by means of the relationship: 

A=DS 

The adaptation matrix A permits the generation of signals scti(t) to 
saN (t) adapted to the spatial configuration of the -reproduction unit using the 
channels c,(j) to c Q {t). Each element A n , q (f) is a filter specifying the contribution of 
the channel c q {i) to the adapted signal sa„(t). Owing to the adaptation matrix A, 
the method of the invention permits optimum reproduction of the sound field 
described by the multi-channel signal by a reproduction unit having any spatial 
configuration. 

In the embodiment described, the matrices D and S are independent of 
the frequency, as is also the matrix A. In that case, the elements of the matrix A 
are constants indicated A nA and each of the adapted signals sa,(t) to sa^t) is 
obtained by simple linear combinations of the input channels c,(t) to c Q {f), where 
appropriate followed by a delay as will be described hereinafter. 

The filters represented by the matrix A may be used in a different form 
and/or in different filtering methods. If the filters used are parameterized directly 
with frequency responses, the coefficients A n , q (J) are provided directly by step 50. 
Advantageously, step 50 for determining adaptation filters comprises a 
conversion sub-step 57 in order to determine the parameters of the filters for 
other filtering methods. 

For example, the filtering combinations A n Jj) are converted into: 

- finite impulse responses a„, q (t) calculated by inverse temporal 
Fourier transform of A„, q (f), each impulse response a n>q (t) is sampled and 
then truncated to a length suitable for each response; or 

- coefficients of recursive filters having infinite impulse 
responses calculated from the A„ A (j) with adaptation methods. 

At the end of step 50, the parameters of the adaptation filters A n , q {j) are 

provided. 

As stated above, step 60 permits the determination of the filters for 
compensating for the sound characteristics of the elements of the reproduction 
unit 2 in the case where parameters relating to those sound characteristics, such 
as the frequency responses H„(j), are determined in step 10 for determining the 
parameters. 



20 

The determination of such filters, indicated H(P.(f) , using frequency 
responses #„(/), can be carried out in a conventional manner by applying filter 
inversion methods, such as, for example, direct inversion, deconvolution 
methods, Wiener methods or the like. 

As a function of the embodiments, the compensation relates solely to 
the amplitude of the response or also to the amplitude and the phase. 

This step 60 permits the determination of a compensation filter for 
each element 3„of the reproduction unit 2 as a function of its specific sound 
characteristics. 

As above, these filters may be used in a different form an d/or in 
different filtering methods. If the filters used are parameterized directly with 
frequency responses, the responses HtP(f) are applied directly. Advantageously, 
step 60 for determining compensation filters comprises a conversion sub-step in 
order to determine the parameters of the filters for other filtering methods. 

For example, the filtering combinations HP(f) are converted into: 

- finite impulse responses tiP(i) calculated by inverse temporal 
Fourier transform of H}P(f) , each impulse response Ji\t) is sampled and 
then truncated to a length suitable for each response; or 

- coefficients of recursive filters having infinite impulse 
responses calculated using the HP(f) with adaptation methods. 

At the end of step 60, the parameters of the compensation filters 
HfP(f) are supplied. 

Step 70 for determining control signals will now be described in more 

detail. 

This step 70 comprises a sub-step 80 for applying the adaptation filters 
represented by the matrix A to the multi-channel input signal SI corresponding to 
the sound field to be reproduced. As stated above, the adaptation filters A n #(f) 
incorporate the parameters characteristic of the reproduction unit 2. 

In sub-step 80, adapted signals sa t {t) to sa N (f) are obtained by applying 
the adaptation filters A n #{f) to the channels a(t) to c Q {f) of the signal SI. 

In the embodiment described, the adaptation matrix A is independent 
of the frequency and the adaptation coefficients A n # are applied in the following 
manner: 
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o 

V "(t) =^C q (t) An,q 
q=\ 

The adaptation continues with an adjustment to the gains and the 
application of delays in order to align temporally the wavefronts of the elements 
3i to 3/vof the reproduction unit 2 relative to the furthermost element. The 
5 adapted signals sa } (t) to sa ^t) are deduced from the signals v x (t) to v in 
accordance with the expression: 

r*\ ( \ max( r n ) - r„ 

SCln(t) = Tn Vn\ t 

In other embodiments, the adaptation matrix A varies with the 
frequency and the adaptation filters A n 4f) are applied in the following manner: 

10 Vn(f)=f j Cq{f)A nt q{f) 

q=\ 

with C q (J) denoting the temporal Fourier transform of the channel c q (f) 
and V n (f) being defined by: 

Vn{f) - ^ An ^ e -2*Jr»flc 
Vn 

where SA n (f) is the temporal Fourier transform of sa n (f). 
15 Depending on the form of the parameters of the adaptation filters 

A n , q (j), each filtering of the channels c q (i) by the adaptation filters A ntg (f) can be 
carried out in accordance with conventional filtering methods, such as, for 
example: 

- the parameters are directly the frequency responses A n>q {j), and the 
20 filtering is carried out in the frequency domain, for example, using the usual 

techniques of block convolution; 

- the parameters are directly the finite impulse responses a„^(r), and 
the filtering is carried out in the temporal domain by convolution; or 

- the parameters are the coefficients of infinite impulse response 
25 recursive filters, and the filtering is carried out in the temporal domain by means 

of recurrence relations. 

Sub-step 80 is terminated by an adjustment to the gains and the 
application of delays in order to align temporally the wavefronts of elements 3i to 
3 N of the reproduction unit 2 relative to the furthermost element. The adapted 
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signals sa\(t) to sa^t) are deduced from the signals vi(r) to v^t) in accordance with 
the expression: 

sc n (t) = r n v^- max ( r ;>- r " j 

Figure 8 shows the filtering structure corresponding to sub-step 80 for 
5 applying the filters for spatial adaptation as described above. 

Advantageously, step 70 comprises a sub-step 90 for compensating 
for the sound characteristics of the reproduction unit. Each compensation filter 
HlP(f) is applied to the corresponding adapted signal sa n (t) in order to obtain the 
control signal sc n (i) of the element 3 n , in accordance with the relationship: 
10 SC n (f) = SA n (f) HP(f) 

where SC„(f) is the temporal Fourier transform of sc n (t) and where SA n (f) is the 
temporal Fourier transform of sa n (t). 

The application of the sound characteristic compensation filters HlP(f) 

is described with reference to Figure 9. 
15 Depending on the form of the parameters of these filters, each filtering 

of the signals sa n (t) can be carried out in accordance with conventional filtering 
methods, such as, for example: 

- if the filtering parameters are frequency responses HiP(f) , the filtering 
can be carried out by means of filtering methods in the frequency domain, such 

20 as, for example, block convolution techniques; 

- if the filtering parameters are impulse responses hP(t) 9 the filtering 
can be carried out in the temporal domain by temporal convolution; 

- if the filtering parameters are recurrence relation coefficients, the 
filtering can be carried out in the temporal domain by means of infinite impulse 

25 response recursive filters. 

In some simplified embodiments, the method of the invention does not 
compensate for the specific sound characteristics of the elements of the 
reproduction unit. In that case, step 60 as well as sub-step 90 are not carried out 
and the adapted signals sa x (t) to sa^t) correspond directly to the control signals 

30 sci to sc N . 

By applying the method of the invention, each element 3i to 3 N 
therefore receives a specific control signal sci to sc N and emits a sound field 
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which contributes to the optimum reconstruction of the sound field to be 
reproduced. The simultaneous control of the set of elements 3i to 3 N permits 
optimum reconstruction of the sound field corresponding to the multi-channel 
input signal by the reproduction unit 2 whose spatial configuration may be as 
5 desired, that is to say, does not correspond to a fixed configuration. 

In addition, other embodiments of the method of the invention may be 
envisaged and, in particular, embodiments inspired by techniques described in 
the French patent application filed on 28 February 2002 under number 02 02 585. 

In particular, step 50 for determining the spatial adaptation filters may 
10 take into account numerous optimization parameters, such as: 

- G n (f), representative of the template of element 3 n of the reproduction 
unit specifying the operating frequency band of this element; 

- Ni t m, n (f)* representative of the spatio-temporal response of element 
3 n corresponding to the sound field produced in the listening site 4 by the element 

15 3„, when the latter receives an impulse signal as an input; 

- W(rJ) % describing, for each frequency / considered, a spatial window 
representative of the distribution in space of sound field reconstruction 
constraints, these constraints enabling the distribution in space of the effort for 
reconstructing the sound field to be specified; 

20 - Wiif), describing directly in the form of a weighting of the Fourier- 

Bessel coefficients and for each frequency / considered, a spatial window 
representative of the distribution in space of constraints in respect of the 
reconstruction of the sound field; 

- R(f) t representative, for each frequency / considered, of the radius of 
25 the spatial window when the latter is a ball; 

- ju(f) t representative, for each frequency / considered, of the desired 
local adaptation capacity to the spatial irregularity of the configuration of the 
reproduction unit; 

{(h, *n k )}(f)> constituting, for each frequency / considered, a list of 
30 spatio-temporal functions whose reconstruction is imposed; 

- !(/), imposing, for each frequency / considered, the limit order of 
determination of filters; 

- RM(f), defining, for each frequency / considered, the radiation model 
of the elements 3i to 3 N of the reproduction unit 2. 
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All or some of these optimization parameters may be involved in sub- 
step 54 for determining the decoding matrix D, Thus, as described in the French 
patent application filed under number 02 02 585, the parameters Ni tm .nif) and 
RM(J) are involved in sub-step 53 for determining the radiation matrix Af, the 
5 parameters W(rJ) 9 Wtf) 9 R(J) are involved in sub-step 52 for determining the matrix 
W, the parameters {(/*, m k )}(f) are involved in an additional sub-step in the 
determination of a matrix F. The decoding matrix D is then determined in sub- 
step 54, for each frequency / as a function of the matrices M, W and F and the 
parameters G»(f) and //(/). 

10 Still in accordance with patent application 02 02 585, the calculation of 

the matrix D can be carried out frequency by frequency by considering solely the 
active elements for each frequency considered. This method of determining the 
matrix D involves the parameter G n (J) and permits optimum exploitation of a 
reproduction unit whose elements have different operating frequency bands. 

15 it appears that the implementation of the method of the invention 

described here is more efficient and therefore more rapid than the existing 
methods and especially than the method described in the French patent 
application filed under number 02 02 585. 

For, in order to adapt a multi-channel signal comprising Q channels to 

20 a reproduction unit comprising N elements with a spatial precision of order L, it 
appears that the method of the invention requires QxN adaptation filters instead 
of the Q(L+\f + (L+lfN filters necessary for implementing the method described 
in the French patent application filed under number 02 02 585. 

For example, the adaptation of a "5.1 ITU-R BF 775-1" signal to a 

25 reproduction unit having 5 loudspeakers with a precision of order 5 requires 25 
filters instead of 360 filters. 

Figure 10 shows a diagram of an embodiment of an apparatus using 
the method as described above. 

This apparatus comprises the adaptor 1 which is formed by a unit 110 

30 providing a multi-channel signal, such as an audio-video disc-reading unit 112 
called a DVD reader. The multi-channel signal provided by the unit 110 is 
intended for the elements of the reproduction unit 2. The format of this signal SI is 
recognized automatically by the adaptor 1 which is suitable for causing 
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parameters describing the predetermined general direction associated with each 
channel of the signal SI to correspond thereto. 

According to the invention, this adaptor 1 also incorporates a 
supplementary calculation unit 1 14 as well as data acquisition means 116. 
5 For example, the acquisition means 116 are formed by an infrared 

interface with a remote control or also with a computer and allow a user to 
determine the parameters defining the positions in space of the reproduction 
elements 3i to 3 N . 

These various parameters are used by the calculator 114 to determine 
1 0 the matrix A defining the adaptation filters. 

Subsequently, the calculator 114 applies these adaptation filters to the 
multi-channel signal s/ in order to provide the control signals sci to sc N intended 
for the reproduction unit 2. 

It will be appreciated that the device implementing the invention may 
15 assume other forms, such as software used in a computer or a complete device 
incorporating calibration means as well as means for the acquisition and 
determination of the characteristics of the more complete reproduction unit 

Thus, the method may also be used in the form of a device dedicated 
to the optimization of multi-channel reproduction systems, outside an audio-video 
20 decoder and associated therewith. In that case, the device is suitable for 
receiving as an input a multi-channel signal and for providing as an output control 
signals for elements of a reproduction unit. 

Advantageously, the device is suitable for being connected to the 
acquisition device 100 necessary for the calibration step and/or is provided with 
25 an interface permitting the acquisition of parameters, in particular the position of 
the elements of the reproduction unit and optionally the multi-channel input 
format. 

Such an acquisition device 100 may be connected in a wired or 
wireless manner (radio, infra-red) and may be incorporated in an accessory, such 
30 as a remote control, or may be independent. 

The method may be implemented by a device incorporated in an 
element of an audio-video chain, which element has the task of processing multi- 
channel signals, such as, for example, a so-called "surround" processor or 
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decoder, an audio-video amplifier incorporating multi-channel decoding functions 
or also a completely integrated audio-video chain. 

The method of the invention may also be implemented in an electronic 
card or in a dedicated chip. Advantageously, it may be incorporated in the form of 
5 a program in a signal processor (DSP). 

The method may assume the form of a computer program which is to 
be performed by a computer. The program receives as an input a multi-channel 
signal and provides the control signals for a reproduction unit which is optionally 
incorporated in the computer. 
10 In addition, the calibration means may be produced using a method 

other than that described above, such as, for example, a method inspired by 
techniques described in the French patent application filed on 7 May 2002 under 
number 02 05 741. 



